Skip to content

Update transformers tests to speed-up execution#1211

Merged
dsikka merged 2 commits intomainfrom
update_transformers_tests
Feb 28, 2025
Merged

Update transformers tests to speed-up execution#1211
dsikka merged 2 commits intomainfrom
update_transformers_tests

Conversation

@dsikka
Copy link
Copy Markdown
Collaborator

@dsikka dsikka commented Feb 28, 2025

Summary

  • Dont calculate perplexity for small models
  • Don't process more data than what it is actually required for calibration
  • Move some decompression/run_compressed test cases to nightly
  • From 23 minutes to about 5; overall transformer test time is under 30 minutes from the previous 1+ hrs

@github-actions
Copy link
Copy Markdown

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

@dsikka dsikka added the ready When a PR is ready for review label Feb 28, 2025
@dsikka dsikka changed the title Update quantization tests to speed-up execution Update transformers tests to speed-up execution Feb 28, 2025
@dsikka dsikka enabled auto-merge (squash) February 28, 2025 01:42
Copy link
Copy Markdown
Collaborator

@rahul-tuli rahul-tuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dsikka dsikka merged commit 203c9b7 into main Feb 28, 2025
8 checks passed
@dsikka dsikka deleted the update_transformers_tests branch February 28, 2025 14:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready When a PR is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants